IN-VEHICLE OCCUPANT IMAGE PICKUP APPARATUS 



BACKGROUND OF THE INVENTION 

This invention relates to in-vehicle occupant image pickup apparatuses, and 
more particularly to an apparatus capable of picking up an image of an occupant's 
head in an automobile or other kind of vehicle. 

In recent years, methods for detecting inattentive driving and dozing off while 
driving to raise an alarm has been developed as a technology for supporting safe 
driving of automobiles. Detection is carried out typically by face orientation, line of 
sight or eyelid position of a driver, based upon pickup images of the driver's face. 

To shoot the face of a driver, Japanese Laid-Open Patent Application, 
Publication No. 2000-264128 (JP 2000-264128 A) proposes a vehicular interior 
monitoring device that provides a camera inside the case of an interior rearview mirror 
of an automobile. In this vehicular interior monitoring device, a mirror body is 
constructed of a half mirror, through which the camera can shoot the face of the driver. 

In the aforementioned vehicular interior monitoring device, the camera is 
incorporated in the interior rearview mirror which is installed toward the front on one 
side at an upward and sideward shifted position as viewed from the driver's face, and 
thus the camera shoots the driver's face in a slanting direction from the upward and 
sideward shifted position; i.e., the camera cannot shoot a full-faced pose of the 
driver's face from a direction directly opposite thereto. Accordingly, the device as 
disclosed in the above document is unfit to precisely detect the face orientation, line of 
sight and eyelid position of the driver. 

In actuality, if a camera could be installed near the instrument panel on the 
dashboard, the camera could shoot a full-faced pose of the driver's face from a 
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direction directly opposite thereto, but this arrangement would disadvantageously 

cause the driver some discomfort from the presence of the camera in front of the driver. 

Moreover, when a camera capable of outputting a digital signal is to be used, 

installation of such a digital camera near the instrument panel would create another 
5 problem of inevitably requiring some change in position of indicating meters because 

the digital camera to be mounted together with a digital image processor on a substrate 

needs a large space for installation. 

The present invention has been made to eliminate the above-described 

disadvantages, and it is an exemplified object of the present invention to provide an 
10 in-vehicle occupant image pickup apparatus that can shoot the full face of an occupant, 

such as a driver, from a direction directly opposite thereto, without requiring any 

change in position of the indicating meters in the instrument panel and without causing 

the occupant any discomfort. 

15 SUMMARY OF THE INVENTION 

In one aspect of the present invention, there is provided an in-vehicle occupant 
image pickup apparatus which includes an image pickup unit for shooting a face of an 
occupant of a vehicle, and a mirror installed in an instrument panel on a dashboard of 
20 the vehicle. The image pickup unit is located in a blind spot for the occupant, behind 
a hood that is provided in the dashboard of the vehicle, but reflection in the mirror 
enables the image pickup unit to pick up an image of the face of the occupant. 

With the above in-vehicle occupant image pickup apparatus, the image pickup 
unit can shoot a full-faced pose of the occupant face from a blind spot for the occupant, 
25 thanks to the mirror installed in the instrument panel which reflects the face. 
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Hereupon, the hood provided in the dashboard is typically a sun visor that is usually 
provided above the instrument panel, but may be provided as part of the dashboard. 

In the in-vehicle occupant image pickup apparatus as described above, 
preferably, the image pickup unit may include an infrared/near-infrared camera that 

5 picks up an image of the face, and an infrared/near-infrared-emitting element that 
illuminates the face, and the mirror is made up of a cold filter that reflects 
infrared/near-infrared rays and transmits visible rays. This is because the occupant's 
face can clearly be shot by the infrared/near-infrared camera even in the nighttime, 
with the help of illumination of the infrared/near-infrared rays reflected off the cold 

10 filter. Alternatively, the mirror may be made up of a half mirror. 

The above image pickup unit may includes a camera that picks up an image of 
the face and outputs a digital image signal, and a digital image processor that 
manipulates the digital image signal, whereas the camera and the digital image 
processor are both mounted on one and the same substrate. Such an arrangement 

15 allows an image of the occupant's face captured in the camera to be provided in a 
noiseless condition to undergo digital processing in the digital image processor. 

The above "infrared/near-infrared" is intended to mean at least one of 
"infrared" and "near-infrared"; that is, three cases conceivable is: where to include 
infrared only, where to include near-infrared only, and where to include both of 

20 infrared and near-infrared. 

Other objects and further features of the present invention will become readily 
apparent from the following description of preferred embodiments with reference to 
accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



FIG. 1 is a schematic diagram, in cross section, showing an arrangement of one 
exemplary embodiment of an in-vehicle occupant image pickup apparatus according to 
5 the present invention. 

FIG. 2 is a schematic plan view showing an arrangement of an image pickup 
unit as shown in FIG. 1. 

FIG. 3 is a cross section showing a structure of a cold filter as shown in FIG. 1. 

FIG. 4 is a graph showing transmittance of the cold filter as shown in FIG. 1. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A description will be given of exemplified embodiments of the in-vehicle 
occupant image pickup apparatus according to the present invention with reference to 
15 the drawings. 

The in-vehicle occupant image pickup apparatus according to the present 
invention is exemplified by an embodiment, as shown in FIG. 1, which includes an 
image pickup unit 1 capable of shooting the face of a driver D as an example of an 
occupant of an automobile or other kind of vehicle. The image pickup unit 1 is 
20 located in a blind spot for the occupant (driver D) behind a hood 2A of a dashboard 2, 
and a cold filter 4 serving as a mirror is provided in a instrument panel 3 to enable the 
image pickup unit 1 to pick up an image of the face of the driver D reflected therefrom. 

As shown in FIG. 2, the image pickup unit 1 includes an infrared/near-infrared 
camera 1 A that picks up an image and outputs a digital image signal, a plurality of 
25 infrared/near-infrared-emitting diodes IB (equivalent to the above infrared/near- 
infrared-emitting element) that illuminate the face, and an image signal processor 1C 
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that manipulates the digital image signal outputted from the infrared/near-infrared 
camera 1A, all of which are mounted on one and the same substrate ID. The image 
pickup unit 1 is tilted so that the infrared/near-infrared camera 1A for outputting a 
digital image signal and the infrared/near-infrared-emitting diodes 1 B may face the 
instrument panel 3 and may be opposed to the cold filter 4. 

The above cold filter 4 is put over indicating meters 5 provided in the 
instrument panel 3. The cold filter 4 is, as shown in FIG. 3, made up of a glass 
substrate 4A of which a backside is coated with a thin Ti0 2 layer 4B and a thin SiC>2 
layer 4C. 

The cold filter 4 has light-transmittance characteristics as shown in FIG. 4. 
Specifically, infrared rays (including near-infrared rays) with wavelengths equal to or 
greater than 8Q0nm are generally not transmitted but reflected, while nearly 100% of 
visible rays with wavelengths less than 800nm are transmitted. In addition, the cold 
filter 4 is, as shown in FIG. 1, curved in cross section with a specific curvature that 
permits the infrared/near-infrared rays emitted from the infrared/near-infrared-emitting 
diodes IB of the image pickup unit 1 to be reflected toward the face of the driver D, 
and the infrared/near-infrared rays from the face of the driver D to be reflected toward 
the infrared/near-infrared camera 1 A of the image pickup unit 1 where the captured 
images are outputted in the form of a digital image signal. 

According to the above-described embodiment of the in-vehicle image pickup 
apparatus, the digitized image signal-outputting infrared/near-infrared camera 1 A of 
the image pickup unit 1 located in a blind spot for the driver D behind the hood 2A of 
the dashboard 2 picks up images of a full-faced pose of the face of the driver D while 
the driver D drives the automobile, with the help of the infrared/near-infrared rays 
reflected off the cold filter 4. During night driving, illumination of infrared/near- 
infrared rays emitted from the infrared/near- infrared-emitting diodes IB of the image 
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pickup unit 1 and reflected off the cold filter allows the digitized image signal- 
outputting infrared/near-infrared camera 1 A to clearly pick up images of the face of 
the driver D. 

Digital image signals of images picked up by the digitized image signal- 
5 outputting infrared/near- infrared camera 1 A are manipulated by the image signal 

processor 1C of the image pickup unit 1, and outputted to, for example, a safe driving 
support control device (not shown) of the automobile. The safe driving support 
control device accurately detects the face orientation, line of sight and eyelid position 
of the driver D, so that the safe driving support control device may raise an alarm to 
10 call attention of the driver D when detecting that the driver D is looking off the road or 
dozing off while driving. 

In this embodiment of the in-vehicle occupant image pickup apparatus, the cold 
filter 4 transmits visible rays, and thus the driver D or fellow passengers can see the 
indicating meters 5 inside the instrument panel 3 through the cold filter 4. 
15 Consequently, the indicating meters 5 need not be changed in position, so that the in- 
vehicle occupant image pickup apparatus can be arranged and installed at low cost. 

Moreover, since the image pickup unit 1 including the digitized image signal- 
outputting infrared/near- infrared camera 1 A is installed in a blind spot for the driver D 
and other occupants behind the hood 2A of the dashboard 2, the driver D and other 
20 occupants would not feel any discomfort. Further, since the images of the driver's 
face can be shot from a position near the driver D and from a direction directly 
opposite thereto, the face of the driver D or other occupants can stably be shot in a 
natural state from the direction directly opposite thereto. 

Furthermore, since the image pickup unit 1 has the digitized image signal- 
25 outputting infrared/near-infrared camera 1A, the infrared/near- infrared-emitting diodes 
IB and the image signal processor 1C all mounted on the substrate ID, the images of 



6 



the face of the driver D captured by the digitized image signal-outputting 
infrared/near- infrared camera 1 A can be provided as is in a noiseless condition for a 
subsequent digital image processing, so that the face orientation, line of sight and 
eyelid position of the driver D can accurately be detected at low cost. As the digitized 

5 image signal-outputting infrared/near-infrared camera 1 A, the infrared/near- infrared- 
emitting diodes IB and the image signal processor 1C are mounted on one and the 
same substrate ID, the image pickup unit 1 can be provided at low cost. 

Although the one preferred embodiment of the present invention have been 
described above, the present invention is not limited to the above embodiment, and 

10 various modifications and changes may be made in the in- vehicle occupant image 

pickup apparatus according to the present invention without departing from the spirit 
and scope thereof. For example, the cold filter 4 as a mirror, which is curved in the 
above embodiment, may be provided in the form of a flat plate. 

The cold filter 4 may be substituted with a half mirror. In this instance, the 

15 digitized image signal-outputting infrared/near- infrared camera 1A is replaced with a 
camera that picks up images with visual rays and outputs a digital signal or an analog 
signal. 

As described above, the in-vehicle occupant image pickup apparatus according 
to the present invention is designed to allow an image pickup unit located in a blind 

20 spot for an occupant behind a hood of the dashboard to shoot a full face of the 

occupant from a direction directly opposite thereto with the help of reflection in a 
mirror installed in an instrument panel. According to the present invention, thus, the 
full face of the occupant can be shot from a direction directly opposite thereto without 
requiring any change in position of the indicating meters in the instrument panel and 

25 without causing the occupant any discomfort, and the face orientation, line of sight 
and eyelid position of the occupant can be precisely detected. 
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As illustrated in one aspect of the present invention, if the image pickup unit 
includes an infrared/near-infrared camera that picks up an image of the face, and an 
infrared/near-infrared-emitting element that illuminates the face, and the mirror is 
made up of a cold filter that reflects infrared/near-infrared rays and transmits visible 
rays, the occupant's face can clearly be shot by the infrared/near-infrared camera even 
in the nighttime, with the help of illumination of the infrared/near-infrared rays 
reflected off the cold filter, while the occupant can see the indicating meters through 
the cold filter. 

If a digital image processor is mounted on the substrate on which the camera 
that picks up an image of the face and outputs a digital image signal, the image of the 
occupant's face picked up by the camera can be provided as is in a noiseless condition 
for a subsequent digital image processing, so that the face orientation, line of sight and 
eyelid position of the driver can accurately be detected at low cost. 
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